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Animating Image Editing Apparatus a nd 
Animating Image Editing Me thod 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to animating image 
editing apparatus and animating image editing method 
for editing a coded animating image. 
Related Background Art 

Recently, coding methods of coding a digital 
animating image at a high compression ratio by using an 
interframe correlation have been standardized as 
international methods. There is an MPEG as a 
representative method. According to the MPEG, an 
interframe correlation is maximally used, a motion 
compensation is performed with reference to frames 
before and after a frame to be coded, and after that, 
an interframe differential coding is executed. Fig. 5 
shows an example of the MPEG coding. In the coding 
frame types of the MPEG, I frame, P frame, and B frame 
have been coded as shown in the diagram. Tftie I frame 
is the independent frame in an intraframe code and one 
frame is inserted per 15 frames. The P frame is a 
forward motion predictive frame and is an later frame 
code for performing the motion compensation by 
referring to the one-preceding P frame or the I frame. 
The B frame is an interframe predictive code for 
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performing the motion compensation by predicting from 
both directions of the P and I frames before and after 
the B frame. The motion compensation is performed on a 
unit basis of a block which is called a macro block 
(MB) as shown in Fig* 6. The MB is a unit such that an 
animating image is digitized at a sampling ratio of 
4 : 1 : 1 of Y (luminance component) and Cb and Cr 
(color difference components) and, after that, Y 
(16 x 16 pixels), Cb (8 x 8 pixels), and Cr ( 8 x 8 
pixels) are set to a block. The motion compensation is 
executed in the B and P frames. Since the blocks 
having a strong correlation 4*as^to be searched (vector 
search) on a macro block unit basis, there is a 
drawback such that the processes of a coding unit are 
complicated as compared with those of a decoding unit. 
Particularly, when the coding is executed only by a' 
software, it is difficult to execute it in a real-time 
manner. It is, therefore, a present situation that 
only the decoding is performed by $ software. When the 
coding unit is realized by $ hardware, there is a 
drawback such that the circuit scale is extremely 
large. 

As another problem, there is a problem at the 
time of the edition. Fundamentally, since the 
interframe difference is coded, it is difficult to 
perform a cut edition between arbitrary frames. For 
example, when an animating image is divided into two 
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sequences at the position of in Fig. 5, there is a 

drawback such that the last frame cannot be decoded in 
the preceding sequence and the frames up to the next I 
frame cannot be decoded in the later sequence. 

As a first method of solving the foregoing 
problems, there is a method of decoding all of the 
coded frame images and editing the decoded frame images 
after that. 

The above method, however, has a drawback such 
that a memory of a large capacity is necessary to once 
accumulate the images after they were decoded. 

In the above method, there is also n problem 
such that since all of the frame images need to be 
decoded irrespective of a fact such that the frame to 
be edited is a part of animating image and the decoded 
images are again encoded to accumulate them after that, 
the image deterioration is large. 

As a second method of solving the foregoing 
problems, there is also an animating image processing 
apparatus using the intraframe coding method. For 
instance, there is a motion JPEG in which the JPEG 
system which is a coding of a color still image is 
independently applied to each frame of an animating 
image. In case of the motion JPEG, since the coding is 
also the intraframe coding, it is not so complicated as 
in the MPEG and a frame edition can be alsc freely 
performed. However, since the interframe correlation 



is not: used, there is a drawback such that a 
compression efficiency is remarkably worse than "that of 
the inter frame coding* 

SUMMARY OF THE INVENTION 

It: is an object: of the invention to provide an 
animating image editing apparatus and an animating 
image editing method which can solve the foregoing 
drawbacks . 

It is another object of the invention to provide 
an animating image editing apparatus and an animating 
image editing method which do not require a memory of a 
large capacity when an editing process of coded 
animating image data is executed. 

According to a preferred embodiment of the 
invention, the above objects are accomplished by an 
animating image editing apparatus comprising decoding 
means for decoding coded animating image data, storing 
means for intraframe coding the decoded animating image 
data and storing, editing means for decoding the 
intraframe coded image stored in the storing means and 
for performing an arbitrary edition to the image, and 
coding means for coding the edited frame image by an 
animating image coding method. 

Still another object of the invention is to 
provide an animating image editing apparatus and an 
animating image editing method in which an amount of 



image data to be decoded is extremely suppressed when 
an editing process is performed for a predetermined 
frame . ^ * 

-Ft*rther^-an©the^ ob j ect of the invention is to 
provide an animating image editing apparatus and . an 
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animating image editing method in which, iapirt an 
animating image data can be coded at a high speed and 
an image can be compressed at a high compression after 
edition. - 

-Further— as^ther^ ob j ect of the invention is to 
provide an animating image editing apparatus and an 
animating image editing method which can easily and 
promptly edit an animating image. 

^z^^^ter-^irathe-r^ ob j ect of the invention is to 
provide an animating image editing apparatus and an 
animating image editing method which can edit an 
interf rame coded -an: animating image while m inimizing a 
deterioration of a picture quality. 

-Farther- another" object of the invent ion is to 
provide an animating image editing apparatus and an 
animating image editing method having a novel function. 

The above and other objects and features of the 
present invention will become apparent from the 
following detailed description and the appended claims 
with reference to the accompanying drawings 



BRIEF DESCRIPTION OF THE DRAWINGS 



Fig. 1 is a diagram showing the fir^t 
embodiment ; 

Fig. 2 shows an example of a display picture 
plane for edition; 

Fig. 3 is a diagram showing the second 
embodiment; 

Fig. 4 shows an example such that am intraframe 
coding was performed to a part of a sequence; 

Fig. 5 is a diagram showing a state of a 
sequence when an interframe coding is performed; 

Fig. 6 is a diagram showing a macro block; 

Fig. 7 is a block diagram showing a 
constructional outline of a system according to the 
fourth to sixth embodiments; 

Fig. 8 is a block diagram of a main section of 
the fourth embodiment; 

Fig. 9 is an explanatory diagram of the fifth 
embodiment ; 

Fig. 10 is a block diagram of a mair section of 
the fifth embodiment; and 

Fig. 11 is a block diagram of a main section of 
the sixth embodiment. 



DETAILED DESCRIP TION OF THE PREFERRED EMBODI MENTS 
< First embodiment > 

Fig. 1 is a block diagram of the first 
embodiment. Reference numeral 1 denotes a video camera 



for inputting an animating image; 2 a capture board 
unit for forming each frame of the animating image; 3 a 
JPEG codec unit for performing intraframe coding and 
decoding (processing a program by a CPU 9); 4a disk 
for accumulating animating images; 5 a vid^o RAM unit 
for outputting the decoded animating image to a display 
7; 6 an MPEG codec unit for coding/decoding an 
interframe coded animating image (processing a program 
by the CPU 9 ) ; 9 the CPU to control the apparatus . An 
animating image to be processed is inputted from the 
video camera 1 and is digitized by the vidqiO capture 
board unit. Reference numeral 19 denotes &\n operation 
unit including a mouse, or a pointer, which will be 
described hereinlater. In the embodiment, (360 pixels 
x 240 lines) construct one frame and digital animating 
images of 30 frames per second are formed. As pixel 
signals, the Y, Cb, Cr signals obtained by the sampling 
at the sampling ratio of (4:1:1) which is performed 
by the MPEG or the like are used. The Y, Cb, and Cr 
signals formed by the capture board unit 2 are coded in 
the frame by the JPEG codec unit 3 through a computer 
bus 8 in a real-time manner. The coding is executed by 
the JPEG system by regarding each frame as a still 
image on a frame unit basis. Since the JPBG coding 
system has been well-known, the description is omitted 
here. The coded animating images of 30 frames/second 
are stored into the disk 4 through the computer bus 8 



in a real-time manner. In parallel with the coding, 
the digital animating images formed by the capture 
board unit 2 are sent to the video RAM unit 5 and are 
converted to the RGB signals for displaying the 
animating images and, after that, the images are 
displayed by the display 7 in a real-time manner* By 
the processes as mentioned above, while the animating 
image inputted from the video camera 1 is displayed by 
the display 7 in a real-time manner, the iiftage is coded 
by the JPEG codec unit 3 and the coded data is stored 
into the disk 4. The input of the animating image to 
the disk 4 is continued until one animating image scene 
(hereinafter, referred to as a sequence) is finished. 
One sequence after completion of the input is 
reproduced on the display 7 as necessary. The 
reproducing process is performed as follows. Codes of 
one sequence are sequentially read out on a frame unit 
basis and are sent to the JPEG codec unit 3 which can 
perform the coding at a speed higher than that in the 
MPEG through the computer bus 8 and are decoded. The 
decoded frames are sequentially transferred to the 
video RAM unit 5 on the frame unit basis as Y, Cb, and 
Cr signals of (360 pixels x 240 lines) and are 
displayed by the display 7 in a manner similar to the 
case of the foregoing real-time animating image input 
display (hereinlater, such an operation is called as a 
normal reproduction) . 



When one animating image sequence is inputted , 
generally, unnecessary portions are often included at 
the positions before and after or in the halfway of the 
sequence. According to the embodiment, therefore, the 
editing process is performed by using a feature of the 
intraframe coding such that each frame is Independent. 

Fig. 2 shows an example of edition. Reference 
numeral 7 denotes the display in which an edition 
window 10 is displayed. In the edition window 10, each 
frame of the sequence of the decoded animating image is 
displayed in a reduced size. As for the reduction, a 
normal method of simply thinning out is used and a 
resolution is decreased to a value such that the 
contents can be known, thereby enabling a few frames to 
be simultaneously displayed. Reference numeral 15 
indicates a frame as a target point at the time of the 
edition. Reference numeral 14 denotes a one-preceding 
frame; 13 a two-preceding frame; 12 a three -preceding 
frame; 16 a one-later frame; 17 a two-later frame; and 
18 a three-later frame. 

In case of the normal reproduction, a frame of a 
size of (360 pixels x 240 lines) is displayed in 
another window ( not shown ) . At the time of the edition 
reproduction, however, since a plurality of frames 
before and after the target frame are displayed as 
mentioned above, the pixels reduced to about (1/4 x 
1/4) are reproduced. In the edition reproduction, the 
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frame 15 is set to a reproduction point and the frames 
before and after such a frame are moved and displayed 
as shown by an arrow* The frames are displayed in a 
normal speed mode, a slow speed mode, sequential frame 
display mode, or the like as necessary. Reference 
numeral 11 denotes an edition tool bar for cutting 
unnecessary frames and for selecting only necessary 
frames. Fig. 2 shows a state in which the frames 13 to 
17 are selected (bars of the hatched portions) by a 
mouse or a pointer. In this case, the frames before 
the frame 12 and the frames after the frame 18 are 
unnecessary portions. The frames other than the 
necessary portions selected as mentioned above are 
deleted and edited from the disk 4. Since the code 
data stored in the disk 4 are the intraframe coded 
data, it can be easily edited. In the embodiment , the 
editing process is executed by the CPU 9 ±%\ a software 
manner. The edited code data can be confirmed by 
performing the normal reproduction as mentioned above. 

The editing process mentioned above is performed 
on the basis of the intraframe code data which can be 
easily edited. After the edition, the intraframe code 
is converted to the interframe code having a 
compression efficiency higher than that of the 
intraframe code and the animating image is efficiently 
restored to the disk 4. One sequence of the edited 
intraframe codes stored in the disk 4 is re^td out every 



frame and is decoded by the JPEG codec unit 3 in a 
manner similar to the normal reproduction. Since there 
is no need to again convert the intraframe code to the 
interframe code in a real-time manner, however, it is 
sufficient for the JPEG codec unit 3 to decode in 
accordance with the speed of the interframe coding. In 
the embodiment, the MPEG system is used to ^tgain encode 
the decoded animating image to the interframe coded 
frame image. Since the re-encoding is performed by ^ 
software by the CPU 9, it is executed by an idle time 
of the CPU. 

According to the MPEG coding, as sholwn in Fig. 
5, the data is interframe/intraf rame coded into three 
kinds of frame types of I, P, and B frames. The coded 
frames are again sequentially stored into tlfie disk 4 in 
accordance with the order from the frame after 
completion of the coding and the above operation is 
continued until the end of the sequence, thereby 
finishing the re-encoding. After that, by deleting an 
unnecessary sequence of the intraframe code$, it is 
converted to the sequence in which the compjt; ession 
efficiency is improved so that the disk 4 is 
efficiently used. 

As mentioned above, the animating image sequence 
which was re-encoded to the interframe codes is 
sequentially decoded by an MPEG codec 6 as nuecessary 
and can be also similarly produced to the display 7 via 
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the video RAM unit 5* 

As mentioned above, the input of th0 animating 
image is coded by the intraframe coding in real-time 
manner, so that the coding can be easily performed with 
a small circuit scale as compared with the case of 
using the inter frame coding by the MPEG. B]f using the 
intraframe code, the animating image can be easily 
edited. By converting the intraframe code to the 
inter frame code of a good compression efficiency after 
the edition, the animating image process suoh that the 
input edition of the animating image is easy and the 
compression efficiency is high is realized. 
< Second embodiment > 

Fig. 3 is a diagram showing the second 
embodiment. The second embodiment relates to a case 
where animating images have already been converted to 
digital codes and stored in a CD-ROM or the like. In 
Fig. 3, reference numeral 20 denotes a CD-ROM player 
which is connected to the computer bus 8 by an SCSI 
bus. In Fig. 3, the same component element (3 as those 
in Fig. 1 are designated by the same reference 
numerals. The CD-ROM player 20 is an animating image 
reading apparatus for displaying animating image data 
generally stored in the CD-ROM onto the display 7. 
Codes are read out from the CD-ROM player 20 at a 
predetermined bit rate. It is generally desirable that 
such a kind of animating images for accumulation have 
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been Inter frame coded from a view point; of the 
compression efficiency. In the second embodiment, a 
case where the animating image coded by th0 MPEG system 
is read out from the CD-ROM will be described- Codes 
of one sequence read out from the CD-ROM player 20 are 
decoded by the MPEG codec 6 via the computer bus 8 in a 
real-time manner. The frame images (360 pixels x 240 
lines; Y, Cb, and Cr signals) sequentially decoded are 
again sequentially converted every frame tc:> the JPEG 
codes as intraf rame codes by the JPEG codeto unit 3 
through the computer bus 8* Simultaneously, the frame 
images decoded by the MPEG codec 6 are normally 
reproduced onto the display 7 via the video RAM unit 5. 
The sequence coded by the JPEG codec unit 3 is 
sequentially stored into the disk 4 by an ijimount 
corresponding to a sequence of a necessary length. 
After completion of the storage, as described in the 
first embodiment, the frame edition can be performed as 
necessary. It is also possible to again convert the 
intraframe code to the interframe code in ©rder to 
raise the compression efficiency. 

As mentioned above, while decoding the 
interframe coded animating image, by re-enqoding to the 
intraframe code, the edition on the frame ijmit basis 
can be promptly and easily performed. 
<Third embodiment> 

In the second embodiment, although the MPEG 
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codes have been decoded and converted "to tjhe intraframe 
codes with respect to all of the sequences?, only the 
neighboring frames to be edited can be alsfo converted 
to the intraframe codes as follows. In Fig. 3, in a 
recording medium (the CD-ROM in the third embodiment) 
which can perform the optical recording, magnetic 
recording, or the like, the MPEG codes (interframe 
codes) stored in the CD-ROM are decoded by the MPEG 
codec 6 and only the display operation is performed. 
In this instance, the re-encoding by the JlPEG codec 
unit is not executed. As for the display, the edition 
reproduction is performed as described in iFig. 2. As 
mentioned above, the necessary portions aris designated 
by the edition tool bar 11. In the case where the 
editing portions have been interframe coded, however, 
the frame edition cannot be easily performed. 
Therefore, a partial intraframe coding conversion as 
shown in Fig. 4 is executed. As an inter fiirame code, 
the I, P, and B frames are encoded every fifteen frames 
between the I frames by the MPEG encoding as described 
in Fig. 5. 



(1) between the B frames in each of the second and 
third frames in Fig. 4, the last B frame of the 
previous sequence of the cut portion cannot be 
reproduced. In the later sequence, a stat^i in which up 



For example, in case of cutting the portion of 
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to the next I frame cannot be reproduced (bpoken link) 
occurs. In the embodiment, therefore, four frames 
between the P frames (between the I and P frames in 
case of the I frame) including the cut portion are 
5 decoded and are again encoded to the I fram0, so that 
the frame edition at an arbitrary position pan be 
performed. Four frames including the portion to be cut 
in the sequence which was read out from the CD-ROM 
player 20 in Fig. 3 are decoded by the MPEG codec 6 and 

10 can be also partially again encoded as an iirtraf rame by 
the CPU 9 in an operational processing, i.e., a 
software manner. In place of again encoding to the 
intraframe in a software manner, the intrac0ding can be 
also performed by the JPEG codec 3. Instead of 

15 decoding all the encoded frames, by partialJLy again 
encoding to the intraframe code only frame images in 
minimum number including frame images indicated to be 
edited upon editing, in which the frames which are not 
edited can be reproduced later, as in the embodiment, 

20 there is no need to again encode to the intferframe code 
for the purpose of the improvement of a compression 
ratio after the edition. A deterioration oil: the 
picture quality can be also minimized to th0 portions 
before and after the edition. 

25 < Fourth embodiment > 

The fourth embodiment will now be described with 
respect to the case where the MPEG system i& used as a 
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to *the next I frame cannot be reproduced (Iproken link) 
occurs* In the embodiment, therefore, fout frames 
between the P frames (between the I and P frames in 
case of the I frame) including the cut portion are 
decoded and are again encoded to the I fratoe, so that 
the frame edition at an arbitrary position can be 
performed. Four frames including the port 1 on to be cut 
in the sequence which was read out from thfc CD-ROM 
player 20 in Fig* 3 are decoded by the MPEKi? codec 6 and 
can be also partially again encoded as an jLntraframe by 
the CPU 9 in an operational processing, i.^., a 
software manner* In place of again encoding to the 
intraframe in a software manner, the intra<:oding can be 
also performed by the JPEG codec 3. Instead of 
decoding all the encoded frames, by partially again 
encoding to the intraframe code only frame images in 
minimum number including frame images indicated to be 
edited upon editing, in which the frames which are not 
edited can be reproduced later, as in the embodiment, 
there is no need to again encode to the inter frame code 
for the purpose of the improvement of a compression 
ratio after the edition. A deterioration <i:>f the 
picture quality can be also minimized to the portions 
before and after the edition. 
< Fourth embodiment > 

The fourth embodiment will now be described with 
respect to the case where the MPEG system is used as a 
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coding system of animating image coding data which is 
inputted , the JPEG system is used as an intraframe 
coding system that is used in the apparatus, all of the 
frames of the animating image coding data which is 
inputted are code converted, and an editing operation 
is executed. 

Fig. 7 is a constructional diagram of the 
animating image editing apparatus of the embodiment . 
Reference numeral 101 denotes a system bus to control 
the whole system; 102 a code converting unjit I for 
decoding animating image coding data that is inputted 
and for converting into the intraframe codling data; 103 
an animating image editing unit for decoding the 
internal coding data and for performing an animating 
image edition; and 104 a code converting unit II for 
again converting the result of the animating image 
edition to the animating image coding data, 

Fig. 8 shows a detailed block construction of 
each processing unit. In the diagram, the same blocks 
as those shown in Fig. 7 are designated by the same 
reference numerals. 

The code converting unit I (102) comprises three 
blocks 120, 121, and 122. Reference numeral 120 
denotes an MPEG decoder for decoding a bit stream which 
is animating image coding data that is inputted and 
which was encoded by the MPEG system; 121 denotes a 
JPEG encoder for encoding the decoded frame image data 
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by the JPEG system as an intraframe code; and 122 a 
memory or file to store an output of the JPEG encoder 
121. 

The animating image editing unit 103 comprises 
5 five blocks 122, 124, 125 , 126, and 122. Reference 

numeral 124 denotes a JPEG decoder; 125 an editing unit 
to edit the animating image on a frame unit basis; 126 
a JPEG encoder to JPEG encode the image data edited by 
the editing unit 125 on the frame unit basJs; and 122 

10 the memory or file to store an output of the JPEG 
encoder 126. 

The code converting unit 104 comprijses two 
blocks 122 and 129. Reference numeral 129 denotes an 
MPEG encoder to encode by the MPEG system. 

15 A processing procedure of the animating image 

editing apparatus of the fourth embodiment will now be 
described hereinbelow with reference to Fi0. 8. 

First, when the animating image codling data 
which has previously been stored in the memory or the 

20 like and encoded by the MPEG system is designated from 
the user by using a pointing device such a$ a mouse or 
the like (not shown), the designated animating image 
coding data is sequentially decoded by the MPEG decoder 
120 in the code converting unit 102 in accordance with 

25 the order of the MPEG bit stream. Subsequently, the 
image data of every frame as an output result is 
inputted to the JPEG encoder 121 and is JPEG encoded on 
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a frame unit basis and is stored into the Memory or 
file 122* The user retrieves an arbitrary frame to be 
edited from the image data which was stored in the 
memory or file 122 and was JPEG encoded , s<3> that an 
animating image editing process can be performed. 

As an animating image edition, the frame 
designated by the user is read out from th& memory or 
file 122 and is decoded by the JPEG decoder 124 and is 
returned to the frame image. An editing operation is 
executed by the editing unit 125 to the im^tge data 
returned to the frame image. The editing operation in 
the embodiment denotes that the image data itself in 
the frame is rewritten. The frame image after 
completion of the editing operation is again encoded 
every frame image by the JPEG encoder 126 in order to 
store into the memory or file 122. When there are a 
plurality of frames to be edited, the above editing 
operation is repeated. After completion of the editing 
operations of all of the frame images to b<fc edited, the 
coding data which was JPEG encoded every frame by the 
code converting unit 104 is read out from the memory or 
file 122. The animating image encoding is executed in 
the MPEG encoder 129 by the MPEG system to all of the 
frames. 

According to the embodiment as mentioned above, 
after the intraframe coding using the JPEG system was 
performed to the input animating image coding data 
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encoded by the MPEG system, the picture plane to be 
edited is retrieved and is subjected to the;, editing 
process and the animating image encoding i& again 
executed. Thus, the animating image coding data can be 
edited and the memory capacity can be remarkably 
reduced as compared with that in case of decoding all 
of the animating image coding data. 
<Fifth embodiment> 

The fourth embodiment has been described with 
respect to the example in which after all of the image 
data which had been animating image encoded by the MPEG 
system was decoded, it is edited. The fifth embodiment 
will be explained with respect to the case where only 
the image data of the portions necessary for edition is 
decoded from the image data which was animating image 
encoded by the MPEG system and is subjected to the 
editing process. 

In the fifth embodiment, it is assumed that the 
image data which was animating image encoded by the 
MPEG system is intraframe encoded ( intra-picture) every 
15 frames. It is also assumed that 20 frames within a 
range from the 20th frame to the 40th frame are used as 
frames to which the user performs the editing process. 

In this case, the image data which is inputted 
and was animating image encoded by the MPEG system has 
a construction as shown at 138 in Fig. 9. In the 
diagram, reference numerals 130 to 134 denote positions 
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of the intra-picture in the image data whidh is 
inputted and was animating image encoded by the MPEG 
system . For example, the intra-picture 130 indicates 
the Oth frame. The next intra-picture 131 indicates 
the 15th frame. In case of the embodiment, since 20 
frames (the 20th frame to the 40th frame) are edited, 
it is sufficient to decode and edit the data with a 
range from the intra-picture 131 to the intra-picture 
133 in a bit stream 138. 

A construction to execute the above processes 
will now be described with reference to Fig. 10. 

In the diagram, blocks which execute operations 
similar to those in the fourth embodiment care 
designated by the same reference numerals. In the 
diagram, reference numeral 140 denotes an intra- 
detector to detect a frame image as an intra-picture in 
the image data which was animating image encoded by the 
MPEG system. 

First, the bit stream 138 is inputted to the 
intra-detector 140. After that, the data within a 
range from the intra-picture 130 to the frame before 
the intra-picture 131, namely, to the 14th frame is 
outputted to a line 141 as an inputted bit stream and 
is stored into a predetermined file. When the code of 
the intra-picture 131 is detected, the frames of the 
intra-picture 131 and subsequent intra-pictures are 
outputted to a line 142 in order to perfomi the editing 
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process. The data of the bit stream outputted to the 
line 142 passes through the MPEG decoder 120 and JPEG 
encoder 121 and each frame is encoded by the JPEG 
system and is supplied to the memory or file 122. The 
intra-detector 140 outputs the signal to the line 142 
until the code of the intra-picture 133 is detected. 
After the code of the intra-picture 133 was detected,, 
the output is again returned to the line 141 and the 
subsequent bit stream is outputted to anottoer file 
different from the above file. 

Coding data 135 and 137 are filed ais mentioned 
above without being subjected to the editing process. 

Processes such that the user edits the 20 frames 
(the 20th to 40th frame) will now be explained. 

The frames (the 15th to 44th frame) have been 
stored in the memory or file as coding data which was 
encoded by the JPEG system. The JPEG coding data 
within a range from the 20th frame to the 40th frame is 
read out from the memory or file 122 and is decoded by 
the JPEG decoder 124, so that the image data is formed. 

After that, the frames (the 20th to 40th frames) 
are edited by the editing unit 125 and are JPEG encoded 
by the JPEG encoder 121 and are stored into the memory 
or file 122. After completion of the editing 
operation, the JPEG coding data is read out from the 
memory or file 122 and is decoded into the image data 
by the JPEG decoder 124. The image data Is further 
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MPEG encoded by the MPEG encoder 129 and is outputted 
to a file or the like. The output result Is filed as 
coding data 136 in Fig, 9* 

The coding data 135 , 136, and 137 are finally 
rearranged into a bit stream as one coding data by a 
CPU or the like (not shown), so that the edition of 
only the necessary frames which are desired by the user 
can be performed. 

In the fifth embodiment, after completion of the 
animating image edition, the frames edited by the JPEG 
system are again encoded by the MPEG system. However, 
the invention is not limited to such a construction. 
It is also possible to construct as follow^. Namely, 
the image data after the edition is stored into the 
memory or file 122 without being JPEG encoded. Only 
the frames which are not subjected to the editing 
process, namely, only the frames (the 15th to 19th 
frames and the 41st to 44th frames) as JPEG codes are 
decoded by the JPEG decoder 124 in the embodiment. The 
edited frames which are not encoded are directly 
outputted to the MPEG encoder without passing through 
the JPEG decoder 124. 

With the above construction, when the animating 
image edition is executed to a predetermined frame, an 
amount of image data to be decoded can be reduced, so 
that the memory capacity to store the imag<& data after 
it was decoded can be reduced. The time that is 
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required for decoding can be also decreased 
Consequently, the animating image edition c::an be 
executed at a high speed. 
<Sixth embodiment> 
5 The above fifth embodiment has been described 

with respect to the case of using the JPEG system as an 
intraframe coding system . However, as shoto in Fig. 
11, the encoding process can be also performed by the 
intra-pictures in an MPEG chip. In the diagram, the 
10 component elements which execute the similar operations 
as those of the component elements in the fourth and 
fifth embodiments are designated by the sanjie reference 
numerals. 

The sixth embodiment differs from Fig. 10 as a 
15 block diagram of the fifth embodiment with respect to a 
point that an MPEG encoder 150 is used in place of the 
JPEG encoder 121 and an MPEG decoder 151 is used in 
place of the JPEG decoder 124. 

The detailed operations are substantially the 
20 same as those in the fifth embodiment except that the 
portions which are stored into the memory or file 122 
are the coding data of the intra-pictures of the MPEG. 
Therefore, the description of the operation principle 
is omitted here. 
25 Although the MPEG system has been used as an 

animating image coding system of the input in the sixth 
embodiment, the invention is not limited tc: such a 
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system but can be also obviously applied to the H261 
system or, further, to another animating iiriage coding 
system. 

Although the internal coding system has been 
5 described with respect to the JPEG system and the 
intra-pictures of the MPEG, the invention is not 
limited to them but can be also applied to any system 
so long as it is the intraframe coding system. 

■S3; 

Although the embodiments have been described 
10 with respect to the example in which the image in the 
frame is changed as an animating image edition, the 
invention is not limited to such an edition. It is 
also possible to change the number of frames or to 
execute an editing operation in the time base direction 
15 such as extraction of frames, insertion of frames, or 
the like. 

It will be also obviously understood that the 
animating image coding data is communicated from 
external communicating means in a real-time manner. 
20 When the image data stored in the memory or file 

122 is edited, the image of only the low frequency 
component is decoded from the image data of one frame 
and is displayed on a monitor (not shown), thereby 
deciding the edition image by using the image of a low 
25 resolution. After that, all of the images of one frame 
are displayed and are subjected to the actmal editing 
process. Thus, the editing process can be performed at 
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a high speed. 

As described above, according to thf* embodiments 
4 to 6, the animating image data which was encoded by 
the animating image coding system using the interf rame 
correlation is once encoded by the intrafretfne coding 
system and is animating image edited and is again 
encoded by the animating image coding syst0.nu Thus, 
the animating image data of the coding data which 
cannot be directly animating image edited so far can be 
edited. The capacity of the image memory that is 
needed during the editing operation can be remarkably 
reduced. 

Further, since the amount of animating image 
data to be decoded when a predetermined fr^me is edited 
can be decreased, the memory capacity can be saved and 
the processes can be executed at a high speed. 

The present invention is not limited to the 
foregoing embodiments but many modifications and 
variations are possible within the spirit and scope of 
the appended claims of the invention. 
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WHAT IS CLAIMED IS: 



An animating image editing apparatus comprising: 
)ding means for decoding encoded animating 

image data; 

storing meahs for intraframe coding and storing 
said decoded animating im^ge data; 

editing means for deeding the images which were 
stored in said storing means and wfere intraframe 
encoded and for performing an arbitrary^edition; and 

coding means for coding said edited ^ame image 
by an animating image coding system. 




2. An apparatus according to claim 1, wherein -ser±3 

A 

encoded^ anim^ing - image data is transmitted from an 
external apparatus by aVcommunication 1 



arbitrary edition is 




3. An apparatus >accorsing to claim 1, wherein ^said 

-edition 



'in one frame or an 



in a time base direction between frames* 



fif /4^^An apparatus according to claim 1, further 



including disglay means, 

wherein safd>^ecoding 
said animating image data 
image data and displays to 



means decodes a part of 
the encoded animating 
displs^ means . 



5. An animating image editing apparatuis cbmprising: 
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intraframe detecting means for detecting an 
intraframe in encoded animating image data; 

defending means for decoding the animating image 
data of a predetermined number of frames after the 
frame detected by^said intraframe detecting means; 

storing means^for storing the animating image 
data decoded by said deqoding means on a frame unit 
basis; 

editing means for performing an arbitrary 
edition to the images of the ^rame unit stored in said 
storing means; and 

coding means for encoding ^said edited frame 
images by an animating image coding \sy stem „ 



6* An apparatus according to claim % further 
including intraframe coding means, 

wherein after said decoded animatiiugV image data 
is intraframe encoded by said intraframe coding means, 
said storing means stores the intraframe coded 
animating image data* 



7. An apparatus\ according to claim 5, wherein^seid 
encoded image da^a is transmitted from an 

external apparatus - by - ^a Gomtriuafleiatioit . 




8* An apparatus according tb claim 6, wherein^sa*d 
encoded A am mati Tig image data is transmitted from an 
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external apparatus by a oommunioatioa -. 



10 



15 



20 



9. Wi apparatus according to claim 5, wherein / sedbd 

A 

arbitrator edition is an edition in the frame or an 
edition i\i a time base direction between f fames * 



/4. 



10. An Apparatus according to claim 6, wherein ©aid 
arbitrary edition is an edition in the fraijne or an 
edition in a txme ba^p direction between f fames. 




11. An apparatus ac&pfc^Lng to claim 5, wherein said 
decoding means executes t^ie decoding from the 
intraframe just before the N frame to be edited by said 
editing means. 

12. An apparatus according to claim 6, wherein said 
decoding means executes -ofie decoding from the 
intraframe just before the\ frame to be edited by said 
editing means. 




fl^/^i&^^Jkn apparatus according to claim 5, wherein said 
decoding means^d^Qodes a part of said animating image 
data in the encoded animeft^ng^JLmage data amd displays 
to display means. 



25 



14. An animating image editing apparatus 
comprising : 
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15 



first encoding means for encoding inputted 
animating Ymage data by a coding method which pays an 
importance tt> a speed; 

memory^ means for storing said animating image 
data encoded byVsaid first encoding means; 

editing means for editing said encoded animating 
image data; and 

second encoding means for encoding said edited 
animating image data by a coding method which pays an 
importance to a compression ratio than said first 
encoding means. 

15. An apparatus according to claim 14, wherein 
said second encoding means executes the encoding 
including an inter frame encoding. 



20 



16. An apparatus according to claim 14, wherein 
said first encoding means executes an intra frame 
encoding . 

17. An apparatus according to claim 14,, wherein 
said edition is an edition on a frame image unit 
constructing said animating image datk. 



25 18. An apparatus according to claiiA 14, wherein 

said first encoding means executes a coding process to 
the input of said animating image data ih a real-time 
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mani\er. 

19. \An apparatus according to claim 14 , further 
including\display means for displaying said animating 
image data\and instructing means for instructing the 
edition to skid editing means, 

wherein said editing means executes said edition 
in accordance with the instruction from said 
instructing means on said display means . 

20. An apparatus according to claim 19 f wherein 
said display means mttlti-screen displays said animating 
image data as a plurality of frame images. 

21 . An apparatus according to claim 20 r wherein 
said multi- screens are images obtained by reducing the 
frame images included in said animating image data. 

22. An apparatus according to claim 19, wherein 
said edition denotes that the animating image data 
which is stored and encoded in said memory means is 
edited in accordance with the\ instruction of said 
instructing means. \ 

23. An apparatus according to claim 14 , wherein 
said first and second encodings We executed on the 
basis of a coding conversion proqram. 
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4. An animating image editing apparatus 



10 



means for decoding animating image data 
Lng method including an interframe 




decoc 
encoded by an 
encoding; 

encoding means for encoding the animating image 
data decoded in parallel with tnse decoding by said 
decoding means by an intraframe encoding; 3md 

editing means for editing said encoded animating 
image data on a frame unit basis. 



ft 
ft 



ft 
ft 



15 



20 



An apparatus according to claim 24 r further 
including display means for displaying^6a4# decoded 
animating ^Linage data . 



26- An apparatus according to claim 24, further 
including memory me\ns for storing <saiet edited 



' raj 



anima'feing ' image data. 



27. An apparatus according to claim 24, further 
including accumulating means \or accumulating the 

n encoding method 



^"-^ 



^ anxmatingf image data encoded by 
including ^-srtrni interframe encodin 

A 



ft 



25 28. An apparatus according to claink24 ( wherein 

- said - x encoding andjj-seid decoding are executed on the 
basis of a conversion program. 
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i9. An animating image editing apparatus 
comprising: 

deciding means for decoding animating image data 
which was encoded by an encoding method injoluding an 
inter frame encodiW and stored in a memory medium; 

display means\for displaying said decoded 
animating image data; \ 

instructing means for giving an editing 
instruction to the animatingVmage data displayed on 
said display means; and \ 

encoding means for intraframe encoding the frame 
images of the minimum number which are necessary to 
decode the animating image data instructed by said 
instructing means in the animating image \ta stored in 
said memory medium. 



^^ov^^An apparatus^according to claim 29, wherein 
said-^enco&mg and^said- decoding are executed on the 
basis of a conversion program. 



,31. An apparatus According to claim 29, wherein 
^ssrid editing process is abutting process of ^a±#- 
animating image data. 



32. An apparatus according to cla^m 29, wherein the 
encoding including^Sii inter frame encoding is an MPEG. 
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An apparatus according to claim 29 , t wherein 



said display, means multi-screen displays y eaid ariimatira 

A 



image data as a 



ity of frame images. 



10 






g to claim 33 y wherein 



,34. An apparatus accor< 
/said multi-screens are images which are obtained by 
reducing the frame images included 
image data. 



An apparatus according to claim 29 , wherein 
said minimum number of frame images include the frame 
images ins^fexucted by said instructing means and are 
images of the\number of frames such that s$tid animating 
image data can ofe decoded without a broken link. 



15 



20 



25 



^> 36. An animating i^aage editing method comprising 
the steps of: 

decoding encoded animating image data; 
intraframe encoding arw^ storing said decoded 
animating image data; 

decoding an image which is Stored in said 
storing step and is intraframe encoded\and performing 
an arbitrary edition; and 

encoding said edited frame images fc^ an 
animating image encoding system. 



/ 



37. An animating image editing method comprising 
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;e steps of: 

intraframe detecting an intraframe in encoded 
animating im&ge data; 

decoding the animating image data of a 
predetermined number o^^rames after the fajrame detected 
by said intraframe detecting^ step; 

storing the animating isqage data dejcoded by said 
decoding step on a frame unit basis 

performing an arbitrary editidn to the images of 
10 the frame unit stored in said storing step; and 
encoding said edited frame images by* 
animating image encoding system m 

An animating image editing method comprising 

s \ 

15 the st^ps of: 

rst encoding inputted animating image data by 
an encoding\nethod which pays an importance to a speed; 

storings, said animating image data encoded by 
said first encoding step; 
20 editing sa:jKwoncoded animating image data; and 

second encodings, said edited animating image data 
by an encoding method whibh pays an importance to a 
compression ratio than said fcirst encoding step. 





25 An animating image editing method comprising 

the steps of: 

decoding animating imag§^da£a_enco($ed by an 
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^ding method including an inter frame encoding; 

erico^ing the animating image data decoded in 
parallel with the^deQOding by said decoding step by an 
intraframe encoding; and 

editing said encoded animating image data on a 
frame unit basis* 
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